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ABSTRACT 



The present invention provides a method and apparatus for 
determining the presence of solid tumor tissue, for identi- 
fying and mapping the margins of solid tumors during 
surgical or diagnostic procedures, and for grading and 
characterizing' tumor tissue by detecting changes in the 
optical properties of an area of interest suspected to contain 
tumor tissue. 

45 Claims, 12 Drawing Sheets 
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METHOD FOR OPTICALLY IMAGING 
SOLID TUMOR TISSUE 

CROSS REFERENCE TO RELATED 
APPLICATIONS 

This patent application is a continuation-in-part of U.S. 
patent application Ser No. 08/073353, filed Jun. 7, 1993 
and issued as U.S. Pat. No. 5,465,718, which is a 
continuation-in-part of U.S. patent application Ser. No. 
07/894,270, filed on Jun. 8, 1992 and issued as U.S. Pat No. 
5,438,989, which is a continuation-in-part of U.S. patent 
application Ser. No. 07/565,454 filed on Aug. 10, 1990 and 
issued as U.S. Pat No. 5,215,095, all of which are incor- 
porated herein by reference in their entirety. 

TECHNICAL FIELD OF THE INVENTION 

The present invention relates to methods and apparatus 
for optically imaging tumor tissue. More specifically, the 
methods and apparatus of the present invention may be used 
to distinguish tumor tissue from normal tissue and to grade 
and characterize tumor tissue. 

BACKGROUND OF THE INVENTION 

A primary goal of surgical treatment of tumors is the 
complete removal of abnormal or pathological tissue while 
sparing normal areas. Hence, a surgeon attempts to distin- 
guish abnormal tissue from adjacent areas of normal tissue 
and to identify boundaries of pathological tissue so mat 
pathological tissue may be removed without affecting sur- 
rounding areas. For example, when removing tumors from 
the cortex, it is important that substantially all the patho- 
logical tissue be removed while minimi ring damage to 
cortical tissue committed to important functions, such as 
language, motor and sensory areas. 

Incidence rates for primary intracranial brain tumors are 
in the range of 50-150 cases per million population or about 
18,000 cases per year. Approximately one half of brain 
tumors are malignant Malignant brain tumors in adults 
occur predominantly in the age range of 40-55 years while 
the incidence of more benign tumors peaks near 35 years of 
age. A primary means for treatment of such tumors is 
surgical removal. Many studies have shown that clinical 
outcome is improved when more of the total amount of 
tumor tissue is removed. For gross total resections of 
tumors, the 5-year survival rate is doubled when compared 
to subtotal resection. Both duration of survival and inde- 
pendent status of the patient are prolonged when the extent 
of resection is maximized in malignant gliomas. Current 
intraoperative techniques do not provide rapid differentia- 
tion of tumor tissue from normal brain tissue, especially 
once the resection of the tumor begins. Development of 
techniques that enhance the ability to identify tumor tissue 
intraoperatively may result in maximizing the degree of 
tumor resection, thereby prolonging survival. 

Of the 500,000 patients projected to die of systemic 
cancer per year in the United States, approximately 25%, or 
over 125,000, can be expected to have intracranial metasta- 
sis. The primary focus for surgery in this group is those 
patients with single lesions who do not have widespread or 
progressive cancer. This group represents about 20-25% of 
patients with metastases (30,000), however, the actual num- 
ber of patients that are good candidates for surgery is slightly 
smaller. Currently, of those patients undergoing surgery, one 
half will have local recurrence of their tumor at the site of 
operation, while the other half will develop a tumor else- 
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where. The fact that about 50% of the surgeries fail at the site 
of operation means that an improved ability to remove as 
much tumor as possible by detecting and localizing tumor 
margins during tumor removal could potentially decrease 

5 the incidence of local recurrence. 

Thus, for both primary and metastatic tumors, the more 
tumor tissue removed, the better the outcome and the longer 
the survival. Further, by maximizing the extent of resection, 
the length of functional, good quality survival is also 

10 increased. 

Most current tumor imaging techniques are performed 
before surgery to provide information about tumor location. 
Presurgery imaging methods include magnetic resonance 
imaging (MRI) and computerized tomography (CT). In the 

15 operating room, only intraoperative ultrasound and stereo- 
taxic systems can provide information about the location of 
tumors. Ultrasound shows location of the tumor from the 
surface, but, once surgery begins, does not provide infor- 
mation to the surgeon necessary to prevent destruction of 

20 important functional tissue while permitting maximal 
removal of tumor tissue. Stereotaxic systems coupled with 
advanced imaging techniques have (at select few hospitals) 
been able to localize tumor margins based upon the preop- 
erative CT or MRI scans. However, studies have shown that 

25 the actual tumor extends 2-3 cm beyond where the image 
enhanced putative tumor is located on preoperative images. 
Therefore, the only reliable method currently available for 
determining the location of tumors is to obtain multiple 
biopsies during surgery and wait for results of microscopic 

30 examination of frozen sections. This technique, known as 
multiple histological margin sampling, suffers several draw- 
backs. First, this is a time-consuming procedure and can add 
about 30 to 90 minutes (depending upon the number of 
samples, taken) to the length of time the patient is under 

35 anesthesia. The increased time required for margin sampling 
leads to increased medical costs, as operating room time 
costs are high. Moreover, increased operating room rime for 
the patient increases the probability of infection. Multiple 
histological margin sampling is prone to errors, as the 

40 pathologist must prepare and evaluate samples in short 
order. In addition, margin sampling does not truly evaluate 
all regions surrounding a primary tumor and some areas of 
residual tumor can be missed due to sampling error. Thus, 
although patient outcome is dependent upon aggressive 

45 removal of tumor tissue, a surgeon must often rely upon an 
estimation technique as a guide. Surgeons must make dif- 
ficult decisions between aggressively removing tissue and 
destroying surrounding functional tissue, and may not know 
the true outcome of the procedure until permanent tissue 

so sections are available about one week later. Consequently, 
an additional surgical procedure may be required. 

Other techniques developed to improve imaging of solid 
tumor masses during surgery include deterrnining the shape 
of visible luminescence spectra from normal and cancerous 

55 tissue. U.S. Pat No. 4,930,516 teaches that the shape of 
visible luminescence spectra from normal and cancerous 
tissue are different Specifically, there is a shift to blue with 
different luminescent intensity peaks in cancerous tissue as 
compared to normal tissue. Thus it is possible to distinguish 

60 cancerous tissue by exciting the tissue with a beam of 
ultraviolet (UV) light and comparing visible native lumi- 
nescence emitted from the tissue with luminescence from a 
non-cancerous control of the same tissue type. Such a 
procedure is fraught with difficulties since a real time, 

65 Spatial map of the tumor location is not provided for the use 
of a surgeon. Moreover, the use of UV light as an excitation 
wavelength can cause photodynamic changes to normal cells 
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and is dangerous for use Id an operating room. In addition, detector, such as a photodiode, that detects one or more 

UV light penetrates only superficially into tissue and optical properties of the illuminated tissue. The detector is 

requires quartz optical components instead of glass. used to obtain control data representing the "normal" or 

Optical imaging of tissue using techniques and apparatus "background" optical properties of an area of interest, and to 
similar to those described herein is described in U.S. patent 5 obtain subsequent data representing the optical properties of 
^plication Ser. No. 08/073353, filed Jun. 7, 1993 and an area of interest following administration of an image- 
issued as U.S. Pat No. 5,465,718, and U.S. patent applica- enhancing dye, or during a monitoring interval. The subse- 
tion Ser. No. 07/894,270, filed on Jun. 8, 1992, and issued <J ucnt data is compared to the control data to identify 
as U.S. Pat No. 5,438,989, both of which are incorporated changes in optical properties representative of uptake of dye 
herein by reference in their entirety. *<> by tumor tissue. According to a preferred embodiment, the 

Therefore, there remains a need in the art for a more subsequent and comparison data are presented in a 

effective method and device for determining solid tumor visual format as una 8 cs * 

locations and precisely mapping tumor margins in a real- Various types of optical detectors may be used, depending 

time mode during surgery. Such a method and device should °u the optical property being detected, the format of data 

further be useful for inexpensive evaluation of any solid 15 being collected, certain properties of the area of interest, and 

tumor by a non-invasive procedure (e.g., breast type of application, e.g., intraoperative, diagnostic, 

mammography) and be capable of grading and characteriz- monitoring, or the like. In general, any type of photon 

ing tumors. detector may be utilized as an optical detector. The optical 

detector generally includes photon sensitive elements and 

SUMMARY OF THE INVENTION 20 optical elements that enhance or process the detected optical 

The methods and device described herein can be used to si « D f ls - Numerous optical detectors are known and may be 

optically distinguish between tumor and non-tumor tissue, used 01 f^P** for use m me methods ™ d ^aratus of the 

and to image margins and dimensions of solid tumors during Present invention. 

surgical or diagnostic procedures. In addition, the methods Changes in optical properties mat may be indicative of 
and device of the present invention can be used to grade and changes of dye perfusion and therefore differentiate tumor 
characterize solid tumor tissue, thereby distinguishing from non-tumor tissue include, for example, reflection, 
malignant from non-malignant tumor tissue. For example, refraction, diffraction, absorption, scattering, birefringence, 
optical imaging techniques of the present invention can be refractive index, Kerr effect, and the like. The optical 
used by a surgeon intraoperatively to distinguish between „ detection system may be incorporated in an apparatus for 
tumor and non-tumor tissue with a high degree of spatial use external to the area of interest, or optical detection 
resolution. Although the optical imaging techniques dis- components may be mounted in an invasive or semi- 
closed herein are used principally for in vivo applications, invasive system, such as an endoscope, laparoscope or the 

they may also be used to distinguish between tumor and like* 

non-tumor tissue in in vitro preparations. The optical imag- ^ Numerous devices for acquiring, processing and display- 
ing techniques can be used to provide information in *real- ing data representative of one or more optical properties of 
time" and therefore can be employed intraoperatively. an area of interest can be employed. One preferred device is 

While the methods and apparatus of the present invention a video camera that acquires control and subsequent images 

may be employed to optically image tumor tissue without of an area of interest that can then be compared to identify 

the use of dyes or contrast-enhancing agents, use of such ^ areas of tumor tissue. Examination of images provides 

agents provides images with higher resolution and is there- precise spatial location of tumors and permits gradation and 

fore pr e fer red. The dynamics of dye perfusion through characterization of tumor tissue. Apparatus suitable for 

fwmfli tissue differ from those through tumor tissue. Thus, obtaining such images have been described in the patents 

using the methods and apparatus described herein, it is incorporated herein by reference and are more fully 

possible to differentiate tumor tissue from surrounding nor- 45 described below. For most surgical and diagnostic uses, the 

mal tissue by monitoring the changes in optical properties optical detector preferably provides images having a high 

resulting from the different kinetics of dye uptake in tumor degree of spatial resolution at a magnification sufficient to 

tissue compared to normal tissue. precisely locate the margins of a tumor. Several images are 

Dyes suitable for use in the present invention include preferably acquired over a predetermined time period and 

fluorescent and phosphorescent materials, dyes that bind to 50 combined, such as by averaging, to provide control and 

cell membranes, optical probes that preferentially accumu- subsequent images for comparison, 

late in tumor tissue, phase resonance dye pairs, and the like. Various data processing techniques may be advanta- 

Examples of appropriate dyes include indocyanines, geously used to assess the data collected in accordance with 

fluoresceins, heinatoporphyrins, and flucresdamines. A pre- the present invention. Comparison data may be assessed or 

f erred dye is indocyanine green which has a broad absorp- 55 presented in a variety of formats. Processing may include 

tion wavelength range and a peak absorption in the range of averaging or otherwise combining a plurality of data sets to 

730 nm to 840 nm. Detectors appropriate for use with such produce control, subsequent or comparison data sets. Images 

dyes, or contrast enhancing agents, are well known in the ait are preferably converted from an analog to a digital form for 

The apparatus of the present invention employs an elec- processing, and back to an analog form for display, 

tromagnetic radiation (emr) source for uniformly illuminat- 60 Data processing may also include amplification of certain 

ing an area of interest (ie., an area believed to contain solid signals or portions of a data set (e.g., areas of an image) to 

tumor tissue), and an optical detector capable of detecting enhance the contrast seen in data set comparisons, and to 

and acquiring data relating to one or more optical properties thereby identify areas of tumor tissue with a high degree of 

of the area of interest In a simple form, the apparatus of the spatial resolution. For example, according to one 

present invention may include an optical fiber operably 65 embodiment, images are processed using a transformation in 

connected to an emr source that illuminates tissue, and which image pixel brightness values are remapped to cover 

another optical fiber operably connected to an optical a broader dynamic range of values. A "low" value may be 
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selected and mapped to zero, with all pixel brightness values 
at or below the low value set to zero, and a "high" value may 
be selected and mapped to a selected value, with all pixel 
brightness values at or above the high value mapped to the 
high value. Pixels having an intermediate brightness value, 
representing the dynamic changes in brightness indicative of 
changes in dye perfusion, may be mapped to linearly or 
logarithmically increasing brightness values. This type of 
processing manipulation is frequently referred to as a "his- 
togram stretch'* and can be used according to the present 
invention to enhance the contrast of data sets, such as 
images, representing differences in tissue type. 

Data processing techniques may also be used to manipu- 
late data sets to provide more accurate combined and 
comparison data. For example, patient movement, 
respiration, heartbeat or reflex activity may shift an area of 
interest during detection of optical properties and data 
collection. It is important that corresponding data points in 
data sets (such as corresponding areas of an image) are 
precisely aligned to provide accurate combined and com- 
parison data. Such alignment may be accomplished manu- 
ally by a practitioner having specialized skill and expertise, 
or using a variety of mathematical means. Optical markers 
may be fixed at an area of interest and detected as the data 
is collected to aid in manual alignment or mathematical 
manipulation. Various processing techniques are described 
below and in the patents incorporated herein by reference. 

Inaccuracies and artifacts caused by patient movement 
during acquisition of data can be reduced by mechanical 
means. According to a preferred embodiment, the emr 
source and the optical detector are provided as an integral 
unit that is mountable to a patient during detection. For 
example, cranial posts may be used to mount an integrated 
emr source/detector unit for localizing or mapping areas of 
cortical tumor tissue. Likewise, an integrated unit including 
an emr source and an optical detector may be mounted in a 
relatively 4 fixed" condition in proximity to other areas of 
interest 

Comparison data may be displayed in a variety of ways. 
For example, comparison data may be displayed in a graphi- 
cal format that highlights optical differences indicative of 
tumor tissue. A preferred technique for presenting and 
displaying comparison data is in the form of visual images 
or photographic frames corresponding to the area of interest 
This format provides a visualizable spatial location (two- or 
three-dimensional) of tumor tissue that is useful for 
treatment, diagnosis and monitoring. To enhance and pro- 
vide better visualization of contrast between tumor and 
normal tissue, comparison images may be processed to 
provide an enhanced contrast grey scale or even a color 
image. A look up table ("LUT") may be provided, for 
example, that converts the gray scale values for each pixel 
to a different (higher contrast) gray scale value, or to a color 
value. Color values may map to a range of grey scale values, 
or color may be used to distinguish between positive-going 
and negative-going optical changes. In general, color- 
converted images provide higher contrast images that high- 
light changes in optical properties representing areas of 
tumor and normal tissue. 

In operation, an area of interest in a patient is illuminated 
with electromagnetic radiation (emr) while one or a series of 
data points or data sets representing one or more optical 
properties of the area of interest is acquired. This data 
represents the control, or background, data. A series of data 
sets is preferably combined, for example by averaging, to 
obtain a control data set The control data set is stored for 
comparison with data collected subsequently. 
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A subsequent data set representing the corresponding 
optical property is acquired during a subsequent time period 
following administration of a dye by bolus injection into 
vasculature circulating to the area of interest A series of 

5 subsequent data sets is preferably combined, for example by 
averaging, to obtain a subsequent data set. The subsequent 
data set is compared with the control data set to obtain a 
comparison data set, preferably a difference data set. Com- 
parison data sets can then be examined for evidence of 

to changes in optical properties representative of areas of 
tumor versus non-tumor tissue within the area of interest 
The methods and apparatus described herein may be 
employed to obtain three-dimensional information of an area 
of interest suspected to contain tumor tissue by: (a) illumi- 

15 nating the area of interest with a least two different wave- 
lengths of emr, (b) obtaining a sequence of control data sets 
corresponding to each wavelength of emr; (c) administering 
a dye; (d) obtaining a sequence of subsequent data sets for 
each wavelength of emr, (e) obtaining a series of compari- 

20 son data sets for each wavelength of light by subtracting the 
control data set from the subsequent data set or alternatively, 
in the case of fluorescent dyes, subtracting the subsequent 
image from the control image; and (f) obtaining an enhanced 
comparison data set by ratioing the first cornparison data set 

25 to the second comparison data set Preferably, the area of 
interest is illuminated with monochromatic emr from a laser 
source. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

The methods and apparatus of the present invention will 
be described in greater detail below with reference to the 
following figures. 
FIG. 1 illustrates identification of low grade human cen- 

35 tral nervous system (CNS) tumor tissue using the methods 
and apparatus of the present invention. This series of images 
is from a patient having a low grade CNS tumor 
(astrocytoma, grade 1). Tumors of this type and grade are 
notoriously difficult to distinguish from normal tissue once 

40 surgical removal of the tumor has begun. In FIG. 1A the 
lettered labels placed upon the brain by the surgeon overlay 
the tumor as identified intraoperatively by ultrasound. FIG. 
IB shows a difference image taken approximately 15 sec- 
onds after intravenous injection of dye (indocyanine green at 

45 1 mg/kg). FIG. 1C shows the difference image about 30 
seconds after dye administration. The area of the tumor 
tissue showed the first tissue staining. FIG. ID shows that 
with this low grade tumor, all tissue (both normal and 
abnormal) showed staining at 45 sec after dye administra- 

50 tion. FIG. IE is an image of the area of interest one minute 
after dye administration and FIG. IF is the image five 
minutes after dye administration, showing complete clear- 
ance in this low grade tumor. 
FIG. 2 illustrates identification of a malignant human 

55 CNS tumor using the methods and apparatus of the present 
invention. The series of images in this Figure are from the 
cortex of a patient with a malignant CNS tumor 
(glioblastoma; astrocytoma, Grade IV). FIG. 2A is a gray- 
scale image, taken before dye injection, showing that malig- 

60 nant brain tumor tissue was densest in the center and to the 
right but that the tissue elsewhere was mostly normal. This 
was confirmed by pathology slides and flow cytometry data 
available one week after surgery. FIG. 2B is the difference 
image at 15 seconds after intravenous injection of indocya- 

65 nine green, showing that the dynamics of dye perfusion in 
the first seconds in malignant tissue are similar to those in 
the first few seconds in benign tumor tissue. FIG. 2C shows 
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that at 30 seconds the malignant tissue is even more intense FIG. 5D shows that 1 minute after dye injection, the dye had 

by comparison to the normal tissue. FIG. 2D (1 minute after cleared from the normal tissue, but was still retained in the 

dye injection) and 2E (10 minutes after dye injection) show tumor region. The concentration of dye in the center of this 

that dye is retained significantly longer in malignant tissue difference image was due to dye circulating in the sagittal 

than in benign tumor tissue, and in some cases, continues to 5 sinus. 

sequester in the malignant tumor tissue over longer periods FIG. 6 illustrates the change in optical properties over 

of time. time due to dye uptake and clearance in tumor vs. non-tumor 

FK5. 3 shows identification of small remnants of tumor tissue through the intact skull. Specifically, this is a plot of 

tissue in the margin of a resected malignant human CNS an average of the percentage change in optical properties 

tumor using the present invention. The images are from an 10 over time averaged over the spatial areas indicated by boxes 

area of interest where a tumor was surgically resected and 1 and 2 from FIG. 5 A. The change in signal is a function of 

biopsies were taken for multiple histological margin sam- the concentration of dye in the tissue at a particular time. The 

piing. The area of interest was thought to be free of tumor graphs labeled "extracranial: tumor" and "extracranial: nor- 

ussue after the surgical removal of the tumor. Normally, in maT show the dynamics of the change in optical properties 

this size of a resection margin, only a single frozen sample 15 over time within boxes 1 and 2, respectively, from FIG. 5A. 

would be taken fox pathology analysis. For the purpose of FIG. 7 shows a spatial map of dynamic changes in tumor 

this study, however, five biopsies were taken from the vs. non-tumor areas in a rat glioma model. These images arc 

margin to aid in correlating the histology with the optical of the same animal as shown in FIG. 5, however the cranium 

image obtained by the present invention. FIG. 3A shows a has now been removed so as to expose the left hemisphere 

gray-scale image of the tumor margin. FIG. 3B shows the 20 containing the glioma, and the right hemisphere containing 

m*rgin with labels that the surgeon placed directly on the normal tissue. FIG. 7A shows a gray-scale image of the area 

brain. The purpose of these labels was to identify where the of interest Box 1 overlays the tumor, Box 2 overlays the 

surgeon was going to remove biopsy samples for histologi- tumor- surround, and Box 3 overlays normal tissue. FIG. 7B 

cal analysis after difference images were acquired with the shows the difference image of the area of interest 1 second 

inventive device. FIG. 3C shows the difference image 1 25 after 1 mg/kg of indocyanine green had been intravenously 

minute after intravenous injection of dye and FIG. 3D shows injected into the animal. During this initial time, the tumor 

the difference image 10 minutes after dye injection. These tissue was the first to show a measurable optical change, 

post-dye difference images reveal a Dumber of sites that indicating that the uptake of dye occurs first in the tumor 

contain tumor tissue as well as areas of normal tissue. The tissue. The gray-scale bar indicates the relative magnitude of 

accuracy of the optical imaging was confirmed post- 30 the optical changes in the sequence of difference images, 

operatively by analysis of the biopsies. Note that a small FIGS. 7C and 7D show difference images of the area of 

area cm the lower right of FIG. 3D indicates a possible region interest 4 seconds and 30 seconds, respectively, after dye 

of tumor tissue that would not have been biopsied by the injection. At these mtermediate stages, dye appears to collect 

surgeon. in both normal and tumor tissue. FIGS. 7E and 7F show 

FIG. 4 illustrates use of the methods and apparatus of the 35 difference images of the area of interest 1 minute and 5 

present invention to identify and characterize tumors that do minutes, respectively, after injection of dye. At these later 

not contrast enhance with MRI imaging. Lack of contrast times, dye still remained in the tumor tissue even though it 

enhancement is usually typical of benign tumors, however a was being cleared from normal tissue, 

proportion of non-benign tumors are not observable with FIG. 8 shows changes in optical properties over time due 

current MRI imaging techniques. The images in this Figure 40 to dye uptake and clearance in tumor vs. non-tumor tissue, 

are from a patient whose tumor did not contrast enhance Specifically, this is a plot of an average of the percentage 

with MRL However, optical imaging as described herein change in optical properties over time averaged over the 

identified this tumor as non-benign. Pathology and flow spatial areas indicated by boxes 1, 2, and 3 in FIG. 7A. The 

cytometry data, available one week later, confirmed that this change in optical properties is a function of the concentra- 

tntnnr was an anaplastic astrocytoma. FIG. 4A shows the 45 tion of dye in the tissue at a particular time. Hie graphs 

gray- scale, field of view, image of the area of interest FIG. labeled '"tumor tissue", 'tumor surround** and "normal 

4B shows the difference image, or control image, prior to brain" are plots of the change in optical properties over time 

dye injection. FIG. 4C shows the area of interest 1 minute within boxes 1, 2 and 3, respectively, from FIG. 7 A. 

after intravenous dye injection, and FIG. 4D shows the area FIG. 9 demonstrates use of optical imaging of dye uptake 

of interest 5 minutes after dye injection. Note that the dye is 50 to reveal residual traces of tumor cells in resected tumor 

retained in the tumor tissue for a significant time. As shown margins. This is a continuation of the study on the same 

in FIGS. 1, 2 and 3, this dynamic trait is characteristic of a animal shown in FIGS. 5 through 8. FIG. 9A shows a higher 

non-benign tumor. magnification image of the left hemisphere tumor margin of 

FK3. 5 shows non-invasive imag in g of dye dynamics and the animal after the tumor has been resected. Boxes 1 

identification of glioma through the intact cranium. FIG. 5A 55 overlay areas that contain small traces of residual tumor 

is a gray-scale image of the cranial surface of a rat The cells, and boxes 2 overlay areas containing only normal 

sagittal suture runs down the center of the image. Tumor tissue. The gray-scale bar indicates the magnitude of optical 

cells had been injected into the left side some days earlier so change in the difference images. FIGS. 9B, 9C, and 9D show 

that this animal had developed a glioma on the left hemi- difference images of the tumor margin 4, 30, and 60 seconds, 

sphere of its brain. The right hemisphere was normal. Box 60 respectively, after intravenous dye injection. Minute biop- 

1 lies over the suspected region of brain tumor, while box 2 sies were taken from areas that showed preferred dye 

ties over normal tissue. FIG. SB is a difference image 1 containment and from areas from which the dye cleared 

second after indocyanine green dye had been intravenously rapidly. These biopsies were analyzed blindly and later 

Injected into the animal. The region containing tumor tissue correlated to the location from which they were taken. Those 

frftriw immediately visible through the intact cranium. 65 biopsies taken from areas which cleared dye were shown to 

FIG. 5C shows that the dye can be seen to profuse through contain only normal cells, whereas biopsies taken from areas 

both normal and tumor tissue 5 seconds after dye injection. which sequestered dye were shown to contain tumor cells. 
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Extremely small islands of residual tumor can thus be **rubber sheet transformations" because they can be viewed 

mapped within tumor margins. as the process of "printing" data, such as an image, on a 

FIG. 10 shows changes in optical properties due to dye sheet of rubber and stretching the sheet according to a 

uptake and clearance in tumor vs. non-tumor tissue. predefined set of rules. As applied to video imaging, sub- 

Specifically, this is a plot of an average of the percentage 5 sequent images can be viewed as having been distorted due 

change in optical properties over time averaged over the to movement and it is desirable to **warp" these images so 

spatial areas indicated by boxes 1 and 2 from FIG. 9A. The that they are spatially aligned with the control images, 

increase in absorption is a function of the concentration of Geometric transformations are distinguished from **point 

dye in the tissue at a particular time. The graphs labeled transf carnation s M in that point transformations modify a 

"margmsrtumor" and "rnargmsinorrnaT are plots of the to pixel's value in an image based solely upon that pixel's 

change in optical properties over time within boxes 1 and 2, value and/or location, and no other pixel values are involved 

respectively, from FIG. 9A. These data, as well as those in the transformation. Geometric transformations are 

from FIG. 9, show that the inventive device and method are described in the publication Digital Image Processing, 

able to distinguish tumor from non-tumor tissue within Gonzalez and Wintz, Addison-Wesley Publishing Co., 

tumor margins with extremely high spatial resolution. is Reading, 1987. 

FIG. 11 is a simplified schematic diagram illustrating an Image is a frame or composition of frames representing 

apparatus of the present invention. one or more optical properties of an area of interest 

Optical Properties relate to various properties detectable 

DETAILED DESCRIPTION OF THE in ^ useful mge 0 f emr (450-2500 nm) including but not 

INVENTION 20 limited to scattering (Rayleigh scattering, reflection/ 

Applicants' optical imaging methods and apparatus are retraction, . diffraction), absorption and extinction, 

described in greater detail below with reference to certain birefringence, refractive index, Kerr effect and the like, 

preferred embodiments. Certain aspects of the optical imag- Optical Detector is a device capable of detecting one or 

ing techniques have been described in even greater detail in more desired optical properties of an area of interest Suit- 

the patents incorporated herein by reference. The detailed 25 able optical detectors include any type of photon detector, 

descriptions of certain preferred embodiments are not such as photodiodes, photomultiplier tubes, cameras, video 

intended to limit the scope of the applicants' invention as cameras, CCD cameras, and the like, 

described herein and set forth in the appended claims. Optical Imaging refers to the acquisition, comparison, 

Definitions processing and display of data representative of one or more 

The following terms, as used in this specification and the so optical properties of an area of interest. Optical imaging may 

appended claims, have the meanings indicated: involve acquisition processing and display of data in the 

Area of Interest is an area of tissue that comprises the form of images, but need not 

subject of acquired data sets. In a preferred embodiment, the Pixels are the individual units of an image in each frame 

area of interest is suspected of containing one or more sites of a digitized signal. The intensity of each pixel is linearly 

of tumor tissue. The area of interest may, for example, be 35 proportional to the intensity of illumination before signal 

exposed tissue, tissue that underlies or is adjacent exposed manipulation and corresponds to the amount of emr 

tissue, or tissue cultured in vitro. (photons) being scattered from a particular area of tissue 

Arithmetic Logic Unit (ALU) is a component that is corresponding to that particular pixel. An image pixel is the 

capable of performing a variety of processing (e.g., math- smallest unit of a digital image and its output intensity can 

ematical and logic) operations (e.g., sum, difference, 40 beany value. A CCD pixel is the smallest detecting element 

comparison, exclusive or multiply by a constant, etc.) on a on a CCD chip and its analog output is linearly proportional 

data set to the number of photons it detects. 

Control Data is data representing one or more optical Subsequent Data is data representing one or more optical 

properties of the area of interest during a "normal" or a properties of an area of interest during a monitoring period 

predetermined period, such as prior to administration of a 45 or subsequent to administration of a dye. 

dye. The control data set establishes a "background" level of Tumor Margin is the area where the surgeon has resected 

optical properties for comparison with a subsequently a tumor, 

acquired data set Apparatus 

Charge Coupled Device (CCD) is a type of optical detec- The inventive methods employ an apparatus comprising a 

tor that utilizes a photo-sensitive silicon chip in place of a 50 source of high intensity emr, an optical detector for acquir- 

pickup tube in a video camera. ing data representative of one or more optical properties of 

Comparison Data is data acquired by comparing subse- the area of interest, such as video signals, and image 

quent data or data acquired at a particular time, with control processing capability. The apparatus may be constructed as 

data, such as by adding, subtracting, or the like. The com- an integrated unit, or it may be used as a collection of 

pari son data set is used to identify and/or locate areas of 55 components. The apparatus will be briefly described with 

tumor versus non-tumor tissue. reference to the schematic diagram, illustrated in FIG. 11, 

Electromagnetic Radiation (emr) means energy having a and various components and features will then be described 

wavelength of from about 450 to about 2500 nm. Emr in greater detail. 

illumination suitable for use in the optical imaging methods FIG. 11 illustrates a human patient 10 whose neuronal 

described herein is in the visible and infrared regions. 60 tissue represents area of interest 12. As is described in 

Frame is a digitized array of pixels. greater detail below, area of interest 12 may be fully or 

Frame Buffer is a component that provides storage of a partially exposed, or imaging may be conducted through 

frame, such as a control image, a subsequent image or a bone and/or dura with proper selection of emr wavelengths, 

comparison image. During optical imaging, area of interest 12 is uniformly 

Geometric Transformations can be used to modify spatial 65 illuminated by emr source 14 powered by regulated power 

relationships between data points in a data set, such as pixels supply 16. Emr is preferably directed through an optical 

in an image. Geometric transformations are often called filter 18 prior to contacting area of interest 12. 
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During optical imaging, a light gathering optical element be employed as an optical detector. Specialized detectors 

29, such as a camera lens, endoscope, optical fibers and suited for detecting selected optical properties may be 

photon detector 22 or the like are placed to detect optical employed. One preferred optical detector for acquiring data 

properties of area of interest 12. Signals representative of in the format of an analog video signal is a charge coupled 

optical properties are processed, if desired, in a gain, offset 5 device (CCD) video camera which produces an output video 

component 24 and then conveyed to analog-to-digital (A/D) signal at 30 Hz having, for example, 5 12 horizontal lines per 

and digital signal processing hardware 26. Data representing frame using standard RS 170 convention. One suitable 

optical properties and particularly changes in optical device is a CCD-72 Solid State Camera (Dage-MTI Inc., 

properties, are displayed on display device 28. The optical Michigan City Ind.). Another suitable device is a COHU 

detection, display and processing components are controlled 10 65 10 CCD Monochrome Camera with a COHU 6500 elec- 

by host computer 30. tronic control box (COHU Electronics, San Diego, Calif.). 

An emr source is used for illuminating the area of interest In some cameras, the analog signal is digitized 8-bits deep 

during acquisition of data representing one or more optical on an ADI board (analog-to-digital board). The CCD may be 

properties. The emr source may be utilized to illuminate an cooled, if necessary, to reduce thermal noise, 

area of interest directly, as when tissue is exposed during or is The optical imaging methods of the present invention may 

in connection with surgery, or it may be utilized to illuminate also usefully employ non-continuous illumination and 

an area of interest indirectly through adjacent or overlying detection techniques. For example, short pulse (time 

tissue such as bone, dura, skin, muscle and the like. domain), pulsed time, and amplitude modulated (frequency 

The emr source employed in the present invention is domain) illumination sources may be used in conjunction 
preferably a high intensity, broad spectrum emr source, such 20 with suitable detectors (See, Yodh, A., and Chance, B. 
as a tungsten-halogen lamp, laser, light emitting diode, or the Physics Today, March, 1995). Frequency domain illumina- 
like. Cutoff filters to selectively pass all wavelengths above tion sources typically comprise an array of multiple source 
or below a selected wavelength may be employed. A pre- elements, such as laser diodes, with each element modulated 
fared cutoff filter excludes all wavelengths below about 695 at 180° out of phase with respect to adjacent elements (see, 
nm. Instead of using cutoff filters, administration of a first 25 Chance, B. et aL, (1993) Proc. Natl Acad, ScL USA, 90, 
dye prior to administration of a second, different dye can act 3423-3427). Two-dimensional arrays, comprising four or 
as a tissue filter of emr to provide a filter in the area of more elements in two orthogonal planes, can be employed to 
interest In this instance, it is desirable to utilize a dye that obtain two-dimensional localization information. Such tech- 
remains with tumor or normal tissue for a prolonged period tuques are described in U.S. Pat. Nos. 4,97233 1 and 5,187, 
of time. 30 672 which are hereby incorporated by reference. 

Preferred emr wavelengths for imaging include, for Hme-of-flight and absarbance techniques (Benaron,D. A. 

example, wavelengths of from about 450 nm to about 2500 and Stevenson, D. K. (1993) Science, 259, 1463-1466) may 

nm, and most preferably, wavelengths of the near infrared also be usefully employed in the present invention. In yet 

spectrum of from about 700 nm to about 2500 nm. another embodiment of the present invention, a scanning 

Generally, longer wavelengths (e.g., approximately 800 nm) 35 laser beam may be used in conjunction with a suitable 

are employed to image deeper areas of tissue. Moreover, if detector, such as a photomultiplier tube, to obtain high 

a difference image is created between the image seen with resolution images of an area of interest 

500 nm emr and the image seen with 700 nm emr, the Illumination with a part of the infrared spectrum allows 

difference image will show an optical slice of tissue. for imaging intrinsic signals through tissue overlying or 

Selected wavelengths of emr may also be used, for example, 40 adjacent the area of interest, such as dura and skull. One 

when various types of contrast enhancing agents are admin- exemplary infrared emr source suitable for imaging through 

iatered. tissue overlying or adjacent the area of interest is a Tunable 

The emr source may be directed to the area of interest by IR Diode Laser from Laser Photonics, Orlando, Fla. When 

a fiber optic means. One preferred arrangement provides emr using this range of far infrared wavelengths, the optical 

through fiber optic strands using a beam splitter controlled 45 detector is preferably provided as an infrared (IR) detector, 

by a D.C. regulated power supply (Lambda, Inc.). IR detectors are made from materials such as indium 

The area of interest must be evenly iUuminated to effec- arsenide, germanium and mercury cadmium telluride, and 

ttvefy adjust the signal over a full dynamic range, as are generally cryogenically cooled to enhance their sensi- 

de scribed below. Nonuniformity of illumination is generally tivity to small changes in infrared radiation. One example of 

caused by fluctuations of the iUumination source and inten- 50 an IR imaging system which may be usefully employed in 

tity variations resulting from the three-dimensional nature of the present invention is an IRC-64 infrared camera 

the tissue surface. More uniform illumination can be pro- (Cincinnati Electronics, Mason Ohio), 

vided over the area of interest, for example, by using diffuse Image (data) processing is an important feature of the 

lighting, mounting a wavelength cutoff filter in front of the optical imaging techniques and apparatus of the present 

optical detector and/or emr source, or combinations thereof. 55 invention. In use, for example, a CCD apparatus is prefer- 

Fluctuation of the illuminati on source itself is preferably ably adjusted (at the level of the analog signal and before 

Addressed fay using a light feedback mechanism to regulate digitizing) to amplify the signal and spread the signal across 

the power supply of the illumination source. In addition, a the full possible dynamic range, thereby maximizing the 

sterile, optically transparent plate may contact and cover the sensitivity of the apparatus. Specific methods for detecting 

area of interest to provide a flatter, more even contour. The 60 optical signals with sensitivity across a full dynamic range 

plate also diminishes tissue movement Fluctuations in illu- are described in detail in the patents incorporated herein by 

mination can be compensated for by using image processing reference. Means for performing a histogram stretch of the 

algorithms, including placing a constant shade gray image difference frames (e.g., Histogram/Feature Extractor HF 

marker point at the area of interest as a control point 15 1-1-V module, Imaging Technology, Woburn Mass.) may 

The apparatus also comprises an optical detector for 65 be provided, for example, to enhance each difference image 

acquiring a signal representative of one or more optical across its dynamic range. Exemplary linear histogram 

properties of the area of interest Any photon detector may stretches are described in Green, Digital Image Processing: 
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A Systems Approach, Van Nostrand Reinhold, New York, warping techniques described in, for example, Wolberg, 
1983. A histogram stretch takes the brightest pixel, or one "Digital Image Warping** IEEE Computer Society Press, Los 
with the highest value in the comparison image, and assigns Alimitos, Calif., 1990, may be used. Image warping tech- 
it the niaximum value. The lowest pixel value is assigned the niques can further indicate when movement has become too 
minimum value, and every other value in between is 5 great for effective compensation and a new averaged control 
assigned a linear value (for a linear histogram stretch) or a image must be acquired. 

logarithmic value (for a log histogram stretch) between the The data processing function is generally operated and 

maximum and minimum values. This allows the comparison controlled by a host computer. The host computer may 

image to take advantage of the full dynamic range and comprise any general computer (such as an IBM PC type 

provide a high contrast image that clearly identifies areas of 10 with an Intel 386, 486 Pentium or similar microprocessor or 

tumor tissue. Sun SPARC) that is interfaced with the emr source and/or 

Noise (such as 60 Hz noise from A.C. power lines) is optical detector and directs data flow, computations, image 

filtered out in the control box by an analog filter. Additional acquisition and die like. Thus, the host computer controls 

adjustments may further enhance, amplify and condition the acquisition and processing of data and provides a user 

analog signal from a CCD detector. One means for adjusting is interface. 

the input analog signal is to digitize this signal at video According to a preferred embodiment, the host computer 

speed (30 Hz), and view the area of interest as a digitized comprises a single-board embedded computer with a 

image that is subsequently converted back to analog format VME64 interface, or a standard (IEEE 1014-1987) VME 

It is important that data, such as consecutive images of a interface, depending upon bus band width considerations, 
particular area of interest, be aligned so that data corre- 20 Host computer boards which may be employed in the 
spending to the same spatial location can be compared. If an present invention include, for example, Force SPARC/CPU- 
averaged control image and a subsequent image are mis- 2E and HP9000 Model 7471. The user interface can be, for 
aligned prior to comparison, artifacts will be present and the example, a Unix/X- Window environment The image pro- 
resulting comparison image will be more like a gradient ccssing board can be, for example, based upon Texas Instru- 
image that amplifies noise and edge information. Image 25 ments' MVP and other chips to provide real-time image 
misalignment can be caused by patient motion, heartbeat averaging, registration and other processing necessary to 
and respiration. Large patient movements may require a new produce high quality difference images for intraoperative . 
orientation of the camera and acquisition of a new averaged viewing. This board will also drive a 120x1024 RGB display 
control image. It is possible, however, to compensate for to show a sequence of difference images over time with 
small tissue movements by either mechanical or compute- 30 pseudo-color mapping to highlight tumor tissue. Preferably, 
tional means, or a combination of both. a second monitor is used for the host computer to increase 

One way to reduce relative movement of the optical the overall screen real estate and smooth the user interface, 

detector and the area of interest is to rigidly secure the The processing board (fully programmable) can support a 

optical detector, and possibly the emr source, to the skeletal VME64 master interface to control data transactions with 

frame of the patient, such as by posts mounted on the 35 the other boards. Lastly, a peripheral control board can 

cranium. The optical detector and emr source may also be provide electrical interfaces to control mechanical interfaces 

provided as an integral unit to reduce relative motion. Other from the host computer. Such mechanical interfaces can 

means for maintaining the optical detector and the illumi- include, for example, the light source and optical detector 

nation source in a constant orientation with respect to the control box. 

area of interest may also be employed. 40 A real-time data acquisition and display system, for 

Real-time motion compensation and geometric transfer- example, may comprise four boards for acquisition, image 

mations may be used to align corresponding data. Simple processing, peripheral control and host computer. A minimal 

mechanical translation of data or more complex (and gen- configuration with reduced processing capabilities may 

erally mare accurate) geometric transformation techniques comprise just the acquisition and host computer boards. The 

can be implemented, depending upon the input data coUec- 45 acquisition board comprises circuitry to perform real-time 

tion rate and amount and type of data processing. For many averaging of incoming video frames and allow readout of 

types of images, it is possible to compensate by a geometri- averaged frames at a maximum rate bus. A VME bus is 

ceil compensation which transforms the image by translation preferred because of its high peak bandwidth and compat- 

in the x-y plane. In order for an algorithm such as this to be ibiliry with a multitude of existing VME products. Hie 

feasible, it must be computationally efficient (preferably 50 acquisition board should also support many different types 

implementable in integer arithmetic), memory efficient, and of optical detectors via a variable scan interface. A daughter 

robust with respect to changes in ambient light. board may support the interfacing needs of many different 

For example, functional control points can be placed in types of optical detectors and supply variable scan signals to 

the area of interest and triangulation-type algorithms used to the acquisition motherboard. Preferably, the unit comprises 

compensate for movements of these control points. Control 55 a daughter board interfacing to an RS-17QA video signal to 

points can be placed directly in the area of interest, such as support a wide base of cameras. Other camera types, such as 

directly on the cortical surface. Goshtasby ("Piece wise Lin- slow scan cameras with a higher spatial/contrast resolution 

ear Mapping Functions for Image Registration** in Pattern and/or better signal to noise ratio, can be developed and 

Recognition vol. 19 pp 459-66, 1986) describes a method incorporated in the inventive device, as well as improved 

whereby an image is divided into triangular regions using 60 daughter boards to accommodate such improved cameras, 

control points. A separate geometrical transformation is According to a preferred embodiment, data, such as 

applied to each triangular region to spatially register each analog video signals, are continuously processed using, for 

control point to a corresponding triangular region in a example, an image analyzer (e.g., Series 151 linage 

control image. Processor, Imaging Technology, Inc., Woburn Mass.). An 

"Image warping" techniques may be employed whereby 65 image analyzer can receive and digitize an analog video 

each subsequent image is registered geometrically to the signal with an analog to digital interface and perform such 

averaged control image to compensate for movement Image a function at a frame speed of about VxAh of a second (e.g., 
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30 Hz or * Video speed"). Processing the signal involves first The processing means may further include an optical disk 

digitizing the signal into a series of pixels or small squares for storing digital data, a printer for providing a hard copy 

assigned a value (in a binary system) dependent upon the of the digital and/or analog data and a display, such as a 

number of photons (i.e., quantity of emr) being detected video monitor to permit the physician to continuously moni- 

from the part of the area of interest assigned to that pixel. For 5 tor the comparison data output. 

example, in a standard 5 12x5 12 image from a CCD camera, a single chassis may house all of the modules necessary 

mere would be 262,144 pixels per image. In an 8 bit system, to provide optical imaging according to the present inven- 

eacfa pixel is represented by 8 bits corresponding to one of tion ^ necessary components, whether or to whatever 

256 levels of gray. ^ degree integrated, may be installed on a rack that is easily 

The signal processing means r^eraWy indudes a pre ^spatoblt md between operating and hospital 

grammable look-up table (eg., CM150-LUT16, Imaging * o . „ . tiU a^k^^,^ * a „„h 

EcbncOogy, Inc., Woburn, Mais.) initialized with valuesfo? ro °™ *f on ? Wllh ***** monitQrs and ™P ut 

converting gray coded pixel values, representative of a black ouxpu ac ^^ s - 

and white image, to color coded values based upon the Imaging Methods 

intensity of each gray coded value. This can provide image ™" for a sohd tumor P^^- 

enhancement via an image stretch. An image stretch is a 15 caU y administering a dye by bolus injection into vasculature 

technique whereby the highest and lowest pixel intensity (eg-, artery or vein) perfusing the suspected tumor site in the 

values used to represent each of the pixels in a digital image area of interest Preferably, the dye has a relatively short half 

frame are determined over a region of the image frame life (e.g., less than five minutes) and is rapidly cleared to 

which is to be stretched. Stretching a selected region over a allow for repeated administration. An optical detector, such 

larger range of values permits, for example, easier identifi- 20 as a video CCD, is focused upon the suspected solid tumor 

cation and removal of relatively high, spurious values due to site (area of interest) and high intensity emr containing a 

noise (e.g. , glare). wavelength which interacts with the dye illuminates the site. 

The processing means may further include a plurality of The form of interaction between the emr and the dye will 

frame buffers having frame storage areas for storing frames depend on the specific dye being used. For example, in the 

of digitized image data received from the analog/digital 25 case of a fluorescent dye, the preferred wavelength of emr is 

interface. Hie frame storage area comprises at least one one which excites the dye, thereby causing fluorescence, 

megabyte of memory space, and preferably at least 8 mega- However with some dyes, such as indocyanine green, the 

bytes of storage space. An additional 16-bit frame storage preferred wavelength of emr is one which is absorbed by the 

area is preferred as an accumulator for storing processed dye. Just prior to administration of the dye, the first averaged 

image frames having pixel intensities represented by more 30 image, or control image is taken, digitized and stored in a 

than 8 bits. The processing means preferably includes at frame buffer. The dye is injected quickly and rapidly as a 

least three frame buffers, one for storing the averaged bolus. Subsequent image frames are taken and stored and 

control image, another for storing the subsequent image, and subtractively compared to produce comparison, or 

a third for storing a comparison image. difference, images (e.g., one or two per second) using the 

According to preferred embodiments, the processing 35 inventive processing means, 
means further comprises an arithmetic logic unit (e.g., Initial visualization of the dye will appear in the corn- 
ALU- 150 Pipeline Processor) for performing arithmetical parison image first in tumor tissue because the dye perfuses 
and logical functions on data located in one or more frame more rapidly into tumor tissue than non-tumor tissue. Solid 
buffers. An ALU may, for example, provide image (data) tumor margins will be the first images to appear in the 
averaging in real time. A newly acquired digitized image 40 comparison image as darkened lines outlining a solid tumor 
may be sent directly to the ALU and combined with control mass. This comparison image can be frozen and stored to 
image stored in a frame buffer. A 16 bit result can be allow the surgeon to study the tumor image and identify 
processed through an ALU, which will divide this result by tumor margins in real time during an operation. The dye will 
a constant (Le. , the total number of images). The output from remain for a longer period of time in tumor tissue compared 
the ALU may be stored in a frame buffer, further processed, 45 to normal tissue. Therefore, after there is general appearance 
or used as an input and combined with another Image. of the dye throughout the area of interest in both normal 

The comparison (e.g., difference) data is, preferably, tissue and tumor tissue, the dye clearance in tumor tissue 

further processed to smooth out the image and remove high will be delayed, allowing another opportunity to visualize 

frequency noise. For example, a lowpass spatial filter can tumor margins by dye presence in tumor tissue but not in 

block high spatial frequencies and/or low spatial frequencies 50 normal tissue. 

to remove high frequency noises at either end of the dynamic The more aggressive or malignant the tumor (higher 
range. This provides a smoothed-out processed difference tumor grade), the longer the dye remains in the tumor tissue, 
image (in digital format). The digitally processed difference For lower grade or more benign tumors, the dye remains in 
image can be color-coded by assigning a spectrum of colors tumor tissue for 45 sec to 2 min, whereas the dye can remain 
to differing shades of gray. This image is then converted 55 in more malignant turners for up to 10 minutes, 
back to an analog image (by anADI board) and displayed for In an alternative embodiment of the present invention, 
a real time visualization of differences between an averaged solid tumor tissue may be distinguished from non-tumor 
control image and subsequent images. Moreover, the pro- tissue and characterized by administering a dye to the area 
ceased difference image can be superimposed over the of interest, illuminating the area of interest with emr con- 
analog image to display specific tissue sites where a dye or 60 taming a wavelength that interacts with the dye, and detect- 
contrast enhancing agent may have a faster uptake. Lag differences in one or more optical properties between the 

Processing speed may be enhanced by adding a real time tumor tissue and non-tumor tissue, 

modular processor or faster CPU chip to the image proces- The inventive method is superior to established tumor 

sor. One example of a real time modular processor which imaging techniques, such as MRI, because it can optically 

may be employed in the present invention is a 150 KTMP- 65 image and distinguish low grade tumors that cannot be 

150 Real Time Modular Processor (Imaging Technology, distinguished with current MRI techniques, and updated 

Woburn, Mass.)- images are continually available during a surgical procedure 
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by readministoing the dye. The dye can be administered on ing molecule, such as an antibody, or more particularly, a 

multiple occasions during a surgical procedure after resec- monoclonal antibody or fragment thereof specific for an 

tion has begun to look at resected walls for residual tumor antigen surface marker of a tumor celL The area of interest 

tissue. For CNS tumors, MRI techniques can only image is iUutniiiatedwimemr contain^ 

advanced stage tumors that have compromised the blood 5 tfj C fluorescent dye but not emission wavelengths. This can 

brain barrier. The present optical imaging method, by be accomplished by use of a cutoff filter over the emr source, 

contrast, can image even low grade tumors that have not yet preferably, the optical detector is coupled to an image 

compromised the blood brain barrier. intensifier or micro channel plate (e.g., KS-1381 Video 

The dye can be any emr-absorbing or fluorescent dye feat s international, Wash D.C.) to increase the sensitivity 

^ ^ S JJ; h T 10 of the system by several orders of magnitude and allow for 

when administered intravenously or intraarteriaUy. Further, visuali / ation G f cells havint . fluc ^cent dves attached 

during surgical resection of a solid tumor, it is important that visualization ot ceils Having m attached 

the dye be rapidly cleared from the area of intS^t so that fiereto. Samples of fluorescent dyes that can conjugated 

dye can be administered repeatedly to image residual tumor £ a ™ lc ^ e ^ ude ^ r ?™£ , CascaoV Blue, 

tissue. Dyes suitable for use with the present invention Texas ***** YeUow CH from Molecular Probes, 

include indocyanines, fluoresceins, hematoporphyrins, fluo- 15 Eugene, Oreg. 

resdamine and other dyes used for photodynamic treatment ^ methods and apparatus described herein for optical 

of tumor tissue, such as those available from Quadra Logic imaging of tumor tissue can operate outside of a surgical 

Technologies, Inc. (Vancouver, B.G). Specific examples of procedure setting. More specifically, it is possible to opti- 

dyes which may be usefully employed with the present cally image tissue through intact skin and bone. In some 

invention include indocyanine green, PHOTOFRIN®, a 20 areas of the body, longer wavelength visible light and near 

hernatoporphyrin dye NPe 6 , BPD, Evans Blue, BODffY® infrared emr can easily pass through tissue, such as breast 

dyes, a series of fluorophores; (available from Molecular tissue. With dye injection, areas of increased vascularity, 

Probes, Inc., Eugene, Oreg.) and combinations thereof. such as tumor tissue can be identified The optical imaging 

Without being bound by theory, the dynamic differences techniques of the present invention can therefore be used, for 

in dye perfusion through normal brain tissue surrounding 25 example, to screen for tumors in breast and other tissue, 
and tumor tissue could be accounted for by any one or a 

combination of the following four reasons: (1) greater EXAMPLE 1 

extravasation of the dye through leaky tumor capillaries; (2) ^ k mustrales flfftod rf a low de 

more rapid uptake of the dye by tumor tissue; (3) slower ^ ^ (astroc ^ oma? ^ 1} using me methods and 
transit times through tumor tissue; and (4) preferential 30 ^ rf ^ ^ A ^ gcan was CQn . 

up^ofmeaVeby tumorceEs. ducted before the operation. However, tumors of this type 

^vasculature in the rat glioma ruodel has been exam- ^ ^ m notariously to distinguish from nor- 

ined and compared to normal cortex Blood flow in tumor oncethe surgical removal of the tumor has begun, 

tissue is slower and more variable than in normal tissue. „ . . ■ , . . . ^ . . ^- , 

These differences have been attributed to tumor location, 35 , Procedures reported ^n this and in the fol- 

degree of infiltration, and necrosis. In other studies using lowm * «^ es were reviewed and approved by the Uni- 

cultured spheroids of C6 astroglial ceUs transplanted into rat v «** of Washmgton Human Subjects Review Committee, 

brain, blood flow was slower in viable tumor than in normal M P*** ^ *? infonne ? ***** form for me 

rat brain. Microvessel volume fraction was equivalent surgery and the imaging experiments, 
between tumor and normal brain. However, since only about 40 The imaging procedure used in Examples 1-4 was as 

50% of the tumor was actively perfused, the surface area of follows. The area of interest was evenly illuminated by a 

perfused microvessels in the tumor was one-half that of the fiber optic light source with the radiation passing through a 

normal brain. These changes could account for a slower flow beam splitter, controlled by a D.C regulated power supply 

of dye through the tumor compared to normal brain and also (Lambda, Inc.) and passed through a 695 nm longpass filter, 

lead to more rapid clearance by the normal brain in contrast 45 Images were acquired with a CCD camera (COHU 6500) 

to the tumor. fitted to the operating microscope with a specially modified 

The permeability of tumor capillaries is much higher than cineadaptonThe cortex was stabilized with a glass footplate, 

that of normal brain. This leakiness of tumor capillaries Images were acquired at 30 Hz and digitized at 8 bits 
leads to extravasation of larger particles resulting in edema . (512x480 pixels, using an Imaging Technology, Inc. Series 

and an increase in interstitial pressure surrounding tumor 50 151 system, Woburn, Mass.). Geometrical transformations 

microvessels. Since tumor microvessels do not contain were applied to images to compensate for small amounts of 

normal arteriole smooth muscle, they also have no local patient motion (Wohlberg, Digital Imaging Warping, 

control of pressure gradients. This leads to a stasis of flow LE.&E. Computer Society, Los Alamitos, Calif., 1988). 

in tumor tissue. The overall effect on dye perfusion is longer Subtraction of images collected following dye adrninistra- 

transit times than in normal brain. Such reasoning supports 55 tion from those collected during a control state with subse- 

the dynamic changes in optical properties in tumor and quent division by the control image resulted in percentage 

normal tissue that are seen during dye perfusion. There is difference maps. Raw data (i.e., no digital enhancement) 

nearly equivalent uptake, but a much slower transit time in were used for determining the average optical change in 

tumor tissue, resulting in prolonged increases in optical specified regions (average size box was 30x30 pixels or 

properties compared to normal tissue. Also, tissue surround- 60 150-250 urn 2 ). For pseudocolor images, a linear low pass 

ing the tumor is expected to have increased interstitial filter removed high frequency noise and linear histogram 

pressures but without leaky capillaries and other microvas- transformations were applied. Noise was defined as the 

culature changes, thereby accounting for the fact that tumor standard deviation of fluctuations in sequentially acquired 

margin tissue has an intermediate duration of optical control images as 0.003-0.009. 

changes. 65 An averaged control image was obtained of the particular 

Yet another aspect of the inventive method involves using cortical surface area of interest. FIG. 1A is a gray-scale 

an emr absorbing or fluorescent dye conjugated to a target- image of the area of interest prior to dye administration. The 
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lettered labels placed upon the brain by the surgeon overlay 
the tumor as identified intraoperatively by ultrasound. 
Indocyanine green dye (1 mg/kg) was administered into a 
peripheral intravenous catheter as a bolus at time 0. FIG. IB 
shows a difference image taken approximately 15 seconds 
after intravenous injection of dye. FIG. 1C shows the 
difference image about 30 seconds after dye administration. 
The area of the tumor tissue showed the first tissue staining. 
FIG. ID shows that with this low grade tumor, all tissue 
(both normal and abnormal) showed staining at 45 sec after 
dye administration. FIG. IE is an image of the area of 
interest one minute after dye administration and FIG. IF is 
the Image five minutes after dye administration showing 
complete clearance in this low grade tumor. In all the 
examples presented herein demonstrating optical imaging in 
humans, each image covers an area of approximately 4 
cmx4 cm. 

These data show that indocyanine green enters low grade 
tumor tissue faster than normal brain tissue, and may take 
longer to be cleared from benign tumor tissue than normal 
tissue. Therefore, it is possible to image even low grade 
tumors with this apparatus. Furthermore, it is possible to 
distinguish low grade tumor tissue from surrounding normal 
tissue intraoperatively- Subsequent pathology of this tumor 
tissue established it as a low grade glioma. 

EXAMPLE 2 

This example illustrates optical imaging of a highly 
malignant CNS tumor (glioblastoma; astrocytoma, grade 
IV). FIG. 2A shows a gray-scale image in which malignant 
brain tumor tissue was densest in the center and to the right 
but that the tissue elsewhere was mostly normal. This 
illustrates that the optical imaging methods and apparatus of 
the present invention may be employed to distinguish 
between tumor and non-tumor tissue without the use of 
contrast enhancing agents, following optimization of the 
gain and offset on the photodetector. However, a higher 
resolution is obtained with the use of contrast enhancing 
agents. The imaging data were confirmed by pathology 
tildes and flow cytometry data available one week after 
surgery. FIG. 2B is the difference image at 15 seconds after 
intravenous injection of indocyanine green, showing that the 
dynamics of dye perfusion in the first seconds in malignant 
tissue are similar to those in the first few seconds in benign 
tumor tissue. FIG. 2C shows that at 30 seconds the (rye 
uptake in malignant tissue is even more intense by compari- 
son to the normal tissue. FIG. 2D (1 minute after dye 
injection) and 2E (10 minutes after dye injection) show that 
dye is retained significantly longer in malignant tissue than 
in benign tumor tissue and, in some cases, continues to 
sequester in the malignant tumor tissue over longer periods 
of time. Therefore, using the apparatus and methods of the 
present invention, it is possible to identify malignant tumor 
tissue, 4i«H"g»«h intraoperatively between normal and 
m*Hgn»nt tumor tissue, and to distinguish between the 
various grades of tumor (e.g., normal vs. benign vs. 
malignant). Thus, it is possible to not only image the 
location and margins of tumor tissue, but also to grade the 
tumor with more malignant tumors retaining dye for a longer 
period of time than lower grade tumors. 

EXAMPLE 3 

This example illustrates optical mapping of the margins of 
a malignant CNS tumor. FIG. 3 shows a series of images and 
difference images of the area of interest taken after surgical 
removal of the tumor and when the area was thought to be 
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free of tumor tissue. Normally, in this size of a resection 
margin, only a single frozen sample would be taken for 
pathology analysis. For the purpose of this study, five 
biopsies were taken from the margin to aid in correlating the 
5 histology with the map obtained by the invention. FIG. 3A 
shows a gray-scale image of the tumor margin. FIG. 3B 
shows the margin with labels that the surgeon placed directly 
on the brain to identify where the surgeon was going to 
remove biopsy samples for histological analysis after dif- 
10 ference images were acquired with the inventive device. 
FIG. 3C shows the difference image 1 minute after intrave- 
nous injection of dye and FIG. 3D shows the difference 
image 10 minutes after dye injection. These post-dye dif- 
ference images reveal a number of sites that contain tumor 
is tissue as well as areas of normal tissue. The accuracy of the 
optical imaging was confirmed post operatively by analysis 
of the biopsies. Note that a small area on the lower right of 
FIG. 3D indicates a possible region of tumor tissue that 
would not have been biopsied by the surgeon. These data 
20 show that the invention is able to identify small remnants of 
tumor tissue in a tumor margin after resection of a tumor. In 
addition, the invention could act as an aid to removing 
biopsies from the site of a tumor margin, thereby reducing 
the sampling error associated with the presently used ran- 
is dom sampling technique. 

EXAMPLE 4 

This example illustrates that the methods and apparatus of 
the present invention can be used to characterize and iden- 
30 tify tumor tissue that does not contrast enhance with tradi- 
tional MRI imaging. Lack of MRI enhancement is usually 
typical of benign tumors. However, a proportion of non- 
benign tumors are not observable with present MRI imaging 

techniques. The images in FIG. 4 are from a patient whose 
35 tumor did not contrast enhance with MRI However, optical 
imaging was able to identify this tumor as a non-benign 
type. Pathology and flow cytometry data available one week 
after surgery confirmed that this tumor was an anoplastic 
astrocytoma. FIG. 4A shows the gray-scale image of the area 
40 of interest FIG. 4B shows the difference image prior to dye 
injection. FIG. 4C shows the area of interest 1 minute after 
intravenous dye injection, and FIG. 4D shows the area of 
interest 5 minutes after dye injection. Note that the dye is 
retained in this tissue for a significant time. As shown in 
45 FIGS. 1, 2, and 3, this dynamic trait is a characteristic of a 
non-benign tumor. 

EXAMPLES 

50 This example illustrates a series of experiments using a rat 
glioma model intraoperatively to investigate whether the 
inventive methods and device could function in an operating 
room setting to provide real time information to the surgeon 
regarding resection of all tumor tissue. 

55 The rat glioma model is a standard predictive model and 
was used to delineate dye uptake, clearance and overall 
parameters of optical imaging that result in the best images. 
The advantages of this model are the ability to consistently 
get reproducible tumors for imaging studies and to resect 

60 tumor under an operating microscope and still find residual 
tumor with the inventive optical imaging. A disadvantage of 
this model is the more sarcoma-like appearance of the tumor 
and a lesser degree of vascularity compared to human 
gliomas. 

65 Briefly, the rat glioma model uses an ethylnitrosourea- 
induced F-344 rat tumor line developed from a clonal 
population of a spinal malignant astrocytoma. This tumor is 
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similar to human astrocytomas microscopically and in vivo, over a 1 sec period while the last control image was being 

because both have stellate-shaped cells in the brain paren- stored. A period of 20 min was allowed between dye 

chyma and both have intracytoplasmic filaments 80-100 injections to allow optical images to return to baseline. The 

mm in diameter as seen by scanning electron microscopy. initial control images of each trial were subtracted from each 

The glioma cells were maintained in Weymouth's medium 5 other to insure that the baseline starting point of each trial 

supplemented with 10% fetal calf serum. Viable cells was equivalent 

(5xl0 4 ) were trypsinized from a monolayer culture and A single control image was chosen and then subtracted 

implanted stereotaxically into the right cerebral hemisphere from each of the controls (4-6 images) and each of the 

of 30 syngeneic female rats, each weighing 140-160 g. The post-dye injection images. The resultant image was divided 

stereotaxic coordinates for right frontal lobe implantation Q by the original control image and multiplied by 100 to give 

were 4.5 mm anterior to the frontal zero plane, 3 mm right a composite percentage difference for the entire sequence 

from the midline and 6 mm deep. The rats were anesthetized before and after dye injection. The optical change mat 

for implantation. The heads were shaved and scalps opened, occurred between separate control images were 0.2-0.7%, 

and a 1 mm burr hole made at the appropriate coordinates. whereas the peak changes resulting from dye injection were 

The cells were injected through a 27 gauge needle, the 15 in fo e ran 8 e of 5-40%. The spatial resolution of an indi- 

needleleftinplacefor30secrK)stmjectionandtheholewas vidnal pixel in the image ranged from 13.5x11.7 mm 2 to 

covered with bone wax. The scalp was sutured and the 27x25.4 mm 2 . Boxes measuring from 15-30 prxels per side 

animals observed for 3^ hrs until they returned to normal wcr * *™ n .? n J» ^ Rentage change 

activity and feeding. The ammals were used 10-14 days m the ind ™^ ««» was calculated and used to demon- 

z~ / . , f * aiu±iia±o w «c uo^ av-i-r uaj* graphically the optical chances over time in the 

after tumor implantation In this model, ammals begin to M ^ J^ cs J^**. 

show clinical symptoms from the tumor by 16-19 days, such T • *. j- . . * . . ~ 

. _ . /v.r*T . , . * n „A * Imaging studies were performed on fourteen animals. The 

as decreased admty and feeding, hemiparesis and eventu- ^ «^ of te h me ^ had a 

ally succumb between 19-27 days from mass effects due to dynamic aspcct . (^ c 7in*&n& of indocyanine green dye 

tumor expansion. perfusion at a dose of 1 mg/kg in 16 separate runs from a 

Fourteen animals underwent complete study, including 25 cor tical surface in 9 different animals demonstrated the 

imaging before and after resection of the tumor. The animals dynamic nature of the optical changes. In all the rat imaging 

were anesthetized with 2% isoflurane, and the femoral vein examples presented herein, each image covers an area no 

cannulated for adininistration of the dye. Anesthesia was greater than approximately 1 cmxl cm. FIG. 7 illustrates the 

maintained with a-chloralose (50 mg/kg administered ip) dynamic differences in changes in optical property due to 

and urethane (160 mg/kg administered ip). The animals were $q dye absorption between tumor and non-tumor tissue. This is 

placed in a stereotaxic holder. Imaging studies were then the same animal as shown in FIG. 5 (see, Example 6), 

carried out before or after removal of the cranium. The however the cranium has now been removed so as to expose 

tumor typically occupied the anterior one half to two thirds the left hemisphere containing the glioma, and the right 

of the right hemisphere exposure. The compressed brain hemisphere containing normal tissue. FIG. 7A shows a 

without any tumor infiltration was defined as the tumor 35 gray-scale image of the area of interest. Box 1 overlays the 

surround to separate it from the normal hemisphere on the tumor, Box 2 overlays the tumor-surround, and Box 3 

contralateral side. overlays normal tissue. FIG. 7B shows the difference image 

Following imaging of the area of interest, an operating of the area of interest 1 second after adniinistration of 

microscope was used to attempt gross total removal of the indocyanine green. During this initial time, the tumor tissue 

tumor. Sites were then chosen for biopsy based on optical 40 is the first to show a measurable optical change, indicating 

imaging results and later analyzed histologically. The biopsy that the uptake of dye occurs first in the tumor tissue. The 

specimens were fixed in 10% paraformaldehyde, Kissl gray-scale bar indicates the relative magnitude of the optical 

stained and mounted. All specimens were read blindly and changes in the sequence of difference images. FIGS. 7C and 

labeled either positive or negative for tumor. These data 7D show difference images of the area of interest 4 seconds 

were correlated to the optical imaging results to identify 45 and 30 seconds, respectively, after dye injection. At these 

residual tumor and statistical analysis (Chi square or student intermediate stages dye appears to collect in both normal 

t-test) was performed to determine the significance of the and tumor tissue. FIGS. 7E and 7F show difference images 

results. of the area of interest 1 minute and 5 minutes, respectively, 

The following imaging apparatus was employed in after injection of dye. At these later times, it becomes clear 

Examples 5 and 6. Light was from a tungsten-halogen bulb 50 that dye is still collecting in tumor tissue even though it is 

regulated by a D.C. power supply, passed through a longpass being cleared from normal tissue. 

filter (690 nm), and through a right angled prism reflected The optical signals begin to change within the first 2-3 

through a 50 or 100 mm objective lens onto the cortical seconds after dye injection and peak 6 seconds after injec- 

surface. The reflected light was collected by the same tion in all three areas, tumor tissue, tumor-surround and 

objective lens and focused by a projection lens onto the 55 normal brain. However, the three different tissue types are 

surface of a CCD camera (COHU 6300). The imaging differentiated by the rate of rise over the first four seconds, 

apparatus was attached to the stereotaxic frame which was the peak optical change reached, and the eventual plateau 

rigidly fixed to a vibration isolation table. Specially that occurs after the first 30 seconds. The tumor tissue had 

designed automatic warping algorithms were designed to a significantly greater peak percentage difference change 

compensate for small amounts of movement Images (512x <$o than the tumor surround which in turn had a greater peak 

480 pixels) were acquired at 30 Hz and digitized at 8 bits percentage different change than the normal brain. For 

(256 gray levels). Every 2 sec, a single image comprising 30 example, following maximization of the gain and offset on 

averaged frames was collected (1 sec) and then stored (1 the camera controls, the peak percentage difference changes 

sec). were as follows: tumor 40.5±9.6%; tumor surround 

Control images were collected prior to intravenous injec- 65 16.4±6.89£>; and normal brain 9.7±4.7%. 

tion of indocyanine green dye at a dose of 1 mg/kg and then FIG. 8 is a plot of an average of the percentage change in 

for 2 min after dye injection. Hie dye injection was made optical properties over time averaged over the spatial areas 
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indicated by boxes 1, 2, and 3 from FIG. 7A. The change in (specificity 89.5%). The two sites that were negative for 

optical property is a function of the concentration of dye in tumor on histology but positive for tumor by optical imaging 

the tissue at a particular time. The graphs labeled "tumor had increased cellularity but were deemed negative for 

tissue**, "tumor surround** and "normal brain** are plots of tumor because there was no focus of tumor tissue present 

the change in optical properties over time within boxes 1, 2, 5 The overall significance of these results are p<0.001. 

and 3, respectively, from FIG. 7A. These data, as well as FIG. 10 shows changes in optical properties due to dye 

those from FIG. 7, show that the inventive method and uptake and clearance in tumor vs. non-tumor tissue, 

device is able to distinguish not only tumor from non-tumor Specifically, this is a plot of an average of the percentage 

tissue, but also tumor-surround areas which contain varying change in optical properties over time averaged over the 

densities of tumor versus normal cells. 10 spatial areas indicated by boxes 1 and 2 from FIG. 9A. The 

Since the peak optical change was always reached 4-6 increase in absorption is a function of the concentration of 

seconds after dye injection, there was also a significantly dye in the tissue at a particular time. The graphs labeled 

faster rate of optical change in the tumor tissue compared to "margins: tumor** and "margins: normal**, are plots of the 

the tumor surround or the normal brain. A more rapid onset changes in optical properties over time within boxes 1 and 

of dye perfusion into the tumor tissue was displayed as a 15 2, respectively, from FIG. 9A. These data, as well as those 

faster time course. The tumor tissue had a more rapid and from FIG. 9, show that the inventive device and method are 

greater rise rime than either the tumor surround or normal able to distinguish tumor from non-tumor tissue within 

brain (p<0.01). tumor margins with extremely high spatial and temporal 

In 13 of 14 animals there was a prolonged increase (>2 resolution, 

min) in the optical signal in the tumor after the normal and 20 oyampi p a 

tumor surround tissue had returned to baseline. Finally, even EXAMPLE o 

the normal and tumor surround tissue were significantly A series of experiments was performed using the rat 

different in dye uptake (rise time: normal 2.4%/sec; tumor glioma model described in Example 5 to investigate whether 

surround 4.0$>/sec). Therefore, the dynamic features of dye the inventive methods and device could image tumor tissue 

uptake and clearance are critical for determining the type of 25 through an intact skull and through intact skin prior to or 

tissue when imaging resection margins. after surgery. Imaging of tumor tissue was attempted 

The rat glioma model also provided an opportunity to through the intact skull of the rat. The extent of tumor 
image resection margins once all visible tumor had been identified was not as accurate as with the cortex exposed, 
removed. FIG. 9A shows a higher magnification image of ^ However, the area lying beneath the skull with tumor tissue 
the left hemisphere tumor margin of the animal after the was easily identified and localized, and continued to con- 
tumor had been resected. Boxes 1 overlay areas that con- centrate dye after several minutes, 
tallied small traces of residual tumor cells, and boxes 2 After dye injection, the area of the tumor initially dem- 
overlay areas that contained only normal tissue. The gray- onstrated a much larger signal man the normal hrain of the 
scale bar indicates the magnitude of optical change in the 35 contralateral hemisphere. One minute after dye injection, the 
difference images. FIGS. 9B, 9C, and 9D show difference dye had been cleared from the normal brain and the only 
Images of the tumor margin 4, 30, and 60 seconds after residual signal remained in tumor tissue and the sagittal/ 
intravenous dye injection, respectively. Minute biopsies transverse sinuses. 

were taken from areas that showed preferred dye contain- FIG. 5A is a gray-scale image of the cranial surface of a 

ment and from areas from which the dye cleared rapidly. ^ rat The sagittal suture runs down the center of the image. 

These biopsies were analyzed blindly and later correlated to Tumor cells had been injected into the left side some days 

the location from which the biopsies were taken. Those earlier so that this animal had developed a glioma on the left 

biopsies taken from areas which cleared dye were shown to hemisphere of its brain. The right hemisphere was normal, 

contain only normal cells, whereas biopsies taken from areas Box 1 lies over the suspected region of brain tumor, and box 

which sequestered dye were shown to contain tumor cells. 4J 2 lies over normal tissue. FIG. 5B is a difference image 1 

The more rapid rate of rise seen in cortical surface second after indocyanine green dye had been intravenously 

imaging was still present for the resection margins that were injected into the animal. The region containing tumor tissue 

positive fox tumor compared to normal brain. Again, sig- becomes immediately visible through the intact cranium, 

niflcant differences between the tumor and the normal brain FIG. 5C shows that the dye can be seen to profuse through 

existed for the rate of rise, peak optical change, and plateau 50 both normal and tumor tissue 5 seconds after dye injection. 

60 seconds after dye injection (all p<0.01). FIGS. 6-9 FIG. 5D shows that 1 minute after dye injection, the normal 

demonstrate that the inventive method and device can be tissue has cleared the dye, but dye is still retained in the 

used in combination with multiple injections of dye for tumor region. The concentration of dye in the center of this 

repeated application throughout a tumor resection surgery difference image is dye circulating in the sagittal sinus, 

(in this case, 4 separate injections of dye were given). 55 The time course of optical changes imaged through the 

Hirmennore, extremely small islands of residual tumor can cranium from ten runs in four animals are shown in FIG. 6. 

be mapped within the tumor margins. The optical changes were determined by the average optical 

Sensitivity and specificity of optical imaging was deter- change in a box placed directly over the tumor and over the 

mined for 34 samples (n=12 animals). Of 15 biopsy sites normal hemisphere. The change in optical properties is a 

tfrenyfl negative for tumor by optical imaging, 14 of the IS 60 function of the concentration of dye in the tissue at a 

were clear of tumor by histological analysis (sensitivity particular time. The graph labeled "extracranial tumor*' is a 

93%). Most of the specimens that were negative for tumor plot of the dynamics of the absorption changes within box 1 

were taken from the posterior wall of the tumor resection from FIG. 5A. The graph labeled "extracranial: normal** is 

cavity or the depth of the cavity (where the hippocampus or a plot of the dynamics of the absorption change within box 

denate gyrus were frequently biopsied). Of 19 biopsy sites 65 2 from FIG. 5A. The peak optical changes for the tumor 

deemed positive for tumor by optical imaging, 17 of the imaged through the cranium were 13.113.9% which was 

biopsy specimens were read as positive for tumor significantly greater compared to those of normal brain of 
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7.&fc23#> (p<0.01). The plateau phase 60 seconds after dye 
injection was also significantly greater in tumor tissue 
(40.5±9.6%) compared to normal brain (3.1±0.7%) 
(p<0,01). 

EXAMPLE 7 

This example illustrates various methods for enhancing 
images obtained from tumor tissue using multiple wave- 
length and/or laser illumination, and a method for extracting 
three-dimensional information using multiple wavelengths. 
We expose a region of cortex in an anesthetized rat, in which 
we have induced tumor growth. First, illuminating with 
white light from a tungsten filament lamp, we acquire a first 
sequence of difference images prior to and following admin- 
istration of a dye, such as indocyanine green or Evans blue, 
into the area of interest. Next, we acquire second and third 
difference image sequences, following the identical proce- 
dure for the first sequence, except that in the second 
sequence, the cortex is illuminated with 690 run and in the 
third sequence with 510 nm light The change in wave- 
lengths is accomplished by placing either a 690tlO nm 
cutoff filter or a 510+10 nm cutoff filter between the light- 
source and the area of interest 

We compute the contrast-enhanced image by first ratioing 
a control 690 nm image with a control 510 nm image. 
Second, we ratio a 690 nm image following dye adminis- 
tration with the corresponding 510 nm image. We then 
combine the ratio images to compute the percentage differ- 
ence image. In this manner, the noise has been significantly 
reduced, hence the signal/noise ratio has been significantly 
increased. 

Next, we extract depth information from the multiple 
wavelength images that we have acquired as follows. 
Longer wavelength light penetrates to a greater depth 
through the cortex than shorter wavelength light Hence, the 
690 nm image penetrates the cortex to x mm, and the 5 10 nm 
image to y mm where x<y. We subtract the 610 nm image 
from the 510 nm image, showing an "optical wedge" con- 
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ing areas of solid tumor tissue, wherein the tumor tissue 
is characterized by one of different rates of dye uptake 
and different rates of dye perfusion compared to normal 
tissue. 

2. A method according to claim 1, wherein the dye is 
selected from the group consisting of indocyanines, 
fluoresceins, hematoporphyrins, fluoresdamines and combi- 
nations thereof. 

3. A method according to claim 1, wherein the area of 
interest is located underneath intact skin and/or bone and the 
emr is in the infrared region. 

4. A method according to claim 1, wherein the illumina- 
tion source and the optical detector are fixed in position 
relative to one another. 

5. A method according to claim 1, wherein the optical 
detector is a video camera. 

6. A method according to claim 1, additionally comprising 
amplifying portions of the control data set to enhance the 
contrast of the comparison data set. 

7. A method according to claim 1, additionally comprising 
identifying data points in the comparison data set having 
intermediate values that represent optical changes indicative 
of solid tumor tissue, and mapping the data points having 
intermediate values to logarithmically or linearly increasing 
values to enhance the contrast of the comparison data set 

8. A method according to claim 1, additionally comprising 
compensating for movement in the area of interest by 
aligning corresponding spatial locations in the control and 
subsequent data sets to produce the comparison data set 

9. A method according to claim 1, wherein the control data 
set is a control image, the subsequent data set is a subsequent 
image, and the comparison data set is a comparison image. 

10. A method according to claim 9, wherein the control 
and subsequent images are obtained as analog video signals 
and the analog video signals are amplified and spread across 
a full dynamic range. 

11. A method according to claim 9, additionally compris- 
ing mapping different pixel values comprising the compari- 
son image to color values to enhance the contrast of the 



within the cortical tissue. By using a series of other cutoff 
niters, we acquire a sequence of images containing infor- 
mation from many different depths of the cortex. Thus, it is 
possible to acquire three-dimensional information. 
We claim: 

1. A method for detecting margins and dimensions of 
tumor tissue in an area of interest, comprising: 

(a) illuminating the area of interest with an iUurnination 
source emitting electromagnetic radiation (emr) having 
at least one wavelength which interacts with a dye, the 
emr having a wavelength of from about 450 nm to 
about 2500 nm; 

(b) detecting one or more optical properties of (he area of 
interest using an optical detector, 

(c) acquiring and storing a control data set representing 
the one or more optical properties detected; 

(d) administering the dye to the area of interest; 

(e) detecting one or more optical properties of the area of 
interest subsequent to administration of the dye and 
acquiring a subsequent data set representing the one or 
more optical properties detected subsequent to admin- 
istration of the dye; 

(f) comparing the subsequent data set with the control 
data set to produce a comparison data set; and 

(g) identifying changes in the one or more optical prop- 
erties in the comparison data set and thereby identify- 
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grading or characterizing tumor tissue 
located in an area of interest, comprising: 

(a) illuminating the area of interest with an iUurnination 
source emitting electromagnetic radiation (emr) having 
at least one wavelength which interacts with a dye, the 
emr having a wavelength of from about 450 nm to 
about 2500 nm; 

(b) detecting one or more optical properties of the area of 
interest using an optical detector, 

(c) acquiring and storing a control data set representing 
the one or more optical properties detected; 

(d) administering the dye to the area of interest; 

(e) detecting one or more optical properties of the area of 
interest subsequent to administration of the dye and 
acquiring a subsequent data set representing the one or 
more optical properties detected subsequent to admin- 
istration of the dye; 

(f) comparing the subsequent data set with the control 
data set to produce a comparison data set; and 

(g) identifying changes in the one or more optical prop- 
erties in the comparison data set, wherein different 
degrees of malignant tumor tissue are characterized by 
one of different rates of dye uptake and different rates 
of dye perfusion compared to lower grade malignant 
tumor tissue and benign tumor tissue. 

13. A method according to claim 12, wherein the dye is 
selected from the group consisting of indocyanines, 
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fluoresceins, heraatoporphyrins, fluoresdamines and combi- 
nations thereof. 

14. A method according to claim 12, wherein the area of 
interest is located underneath intact skin and/or bone and the 
emr is in the infrared region. 5 

15. A method according to claim 12, wherein the illumi- 
nation source and the optical detector are fixed in position 
relative to one another. 

16. A method according to claim 12, wherein the optical 
detector is a video camera. 10 

17. A method according to claim 12, additionally com- 
prising amplifying portions of the control data set to enhance 
the contrast of the comparison data set 

18. A method according to claim 12, additionally com- 
prising identifying data points in the comparison data set 15 
having mtennediate values that represent optical changes 
indicative of solid tumor tissue, and mapping the data points 
having intermediate values to logarithmically or linearly 
increasing values to enhance the contrast of the comparison 
data set 20 

19. A method according to claim 12, additionally com- 
prising compensating for movement in the area of interest by 
aligning corresponding spatial locations in the control and 
subsequent data sets to produce the comparison data set. 

2t. A method according to claim 12, wherein the control 25 
data set is a control image, the subsequent data set is a 
subsequent image, and the comparison data set is a com- 
parison image. 

21. A method according to claim 20, wherein the control 
and subsequent images are obtained as analog video signals 30 
and the analog video signals are amplified and spread across 

a full dynamic range. 

22. A method according to claim 20, additionally com- 
prising mapping different pixel values comprising the com- 
parison image to color values to enhance the contrast of the 35 
comparison image. 

23. A method for distinguishing between tumor tissue and 
non-tumor tissue in an area of interest, comprising: 

(a) administering a dye to the area of interest; 

(b) Htiimiimting the area of interest with an illumination 40 
source emitting electromagnetic radiation (emr) having 

at least one wavelength which interacts with the dye, 
the emr having a wavelength of from about 450 nm to 
about 2500 nm; ^ 

(c) detecting one or more optical properties of the area of 
interest using an optical detector; 

(d) acquiring and storing a data set representing the one or 
more optical properties detected; and 

(e) identifying differences in the one or more optical 50 
properties within the data set and thereby identifying 
areas of solid tumor tissue, wherein the solid tumor 
tissue is characterized by one of different rates of dye 
uptake and different rates of dye perfusion compared to 
normal tissue. 55 

24. A method according to claim 23, wherein the dye is 
selected from the group consisting of indocyanines, 
fluoresceins, hematoporphyrins, fluoresdamines and combi- 
nations thereof. 

25. A method according to claim 23, wherein the area of 60 
interest is located underneath intact skin and/or bone and the 
emr is in me infrared region. 

26. A method according to claim 23, wherein the illumi- 
nation source and the optical detector are fixed in position 
relative to one another. 65 

27. A method according to claim 23, wherein the optical 
detector is a video camera. 



28. A method of grading or characterizing tumor tissue 
located in an area of interest, comprising: 

(a) administering a dye to the area of interest; 

(b) illuminating the area of interest with an illumination 
source emitting electromagnetic radiation (emr) having 
at least one wavelength which interacts with the dye, 
the emr having a wavelength of from about 450 nm to 
about 2500 nm; 

(c) detecting one or more optical properties of the area of 
interest using an optical detector; 

(d) acquiring and storing a data set representing the one or 
more optical properties detected; and 

(e) identifying differences in the one or more optical 
properties within the data set and thereby identifying 
areas of malignant and lower grade tumor tissue, 
wherein different degrees of malignant tumor tissue are 
characterized by one of different rates of dye uptake 
and different rates of dye perfusion compared to the 
lower grade malignant tumor tissue and benign tumor 
tissue. 

29. A method according to claim 28, wherein the dye is 
selected from the group consisting of indocyanines, 
fluoresceins, hematoporphyrins, fluoresdamines and combi- 
nations thereof. 

30. A method according to claim 28, wherein the area of 
interest is located underneath intact skin and/or bone and the 
emr is in the infrared region. 

31. A method according to claim 28, wherein the illumi- 
nation source and the optical detector are fixed in position 
relative to one another. 

32. A method according to claim 28, wherein the optical 
detector is a video camera. 

33. A method for detecting margins and dimensions of 
tumor tissue in an area of interest, comprising: 

(a) illuminating the area of interest with an illumination 
source emitting electromagnetic radiation (emr) having 
at least a first and a second, different, wavelength which 
interact with a dye, the emr being in the visible or 
infrared regions; 

(b) detecting one or more optical properties of the area of 
interest for each of the first and second wavelengths of 
emr using an optical detector; 

(c) acquiring and storing a first and a second control data 
set representing the one or more optical properties 
detected; 

(d) administering the dye to the area of interest; 

(e) detecting one or more optical properties of the area of 
interest for each of the first and second wavelengths of 
emr subsequent to administration of the dye and acquir- 
ing a first and a second subsequent data set representing 
the one or more optical properties detected subsequent 
to administration of the dye; 

(f) comparing the first subsequent data set with the first 
control data set and the second subsequent data set with 
the second control data set to produce a first and a 
second comparison data set; 

(g) obtaining an enhanced comparison data set by ration- 
ing the first comparison data set to the second com- 
parison data set; and 

(h) identifying changes in the one or more optical prop- 
erties in the enhanced comparison data set and thereby 
identifying areas of solid tumor tissue, wherein the 
solid minor tissue is characterized by one of different 
rates of dye uptake and different rates of dye perfusion 
compared to normal tissue. 
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34. A method according to claim l t wherein the dye is an 
emr absorbing, phosphorescent or fluorescent material. 

35. A method according to claim 34, wherein the dye is 
conjugated to a targeting molecule. 

36. A method according to claim 1, further comprising 
illuminating the area of interest with a source of uniform 
illumination. 

37. A method according to claim 1, further comprising 
Eliminating the area of interest with a source of non- 
continuous illumination. 

38. A method according to claim 1, further comprising 
detecting one or more optical properties of the area of 
interest using an optical detection system external to the area 
of interest 

39. A method according to claim 1, further comprising 
detecting one or more optical properties of the area of 
interest using optical detection components mounted on an 
invasive or semi-invasive system, 

40. A method according to claim 23, wherein the dye is an 
emr absorbing, phosphorescent or fluorescent material. 



>9,798 
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41. A method according to claim 40, wherein the dye is 
conjugated to a targeting molecule. 

42. A method according to claim 23, further comprising 
illuminating the area of interest with a source of uniform 
illumination. 

43. A method according to claim 23, further comprising 
illuminating the area of interest with a source of non- 
continuous illumination. 

io 44. A method according to claim 23, further comprising 
detecting one or more optical properties of the area of 
interest using an optical detection system external to the area 
of interest 

15 45. A method according to claim 23, further comprising 
detecting one or more optical properties of the area of 
interest using optical detection components mounted on an 
invasive or semi-invasive system. 

***** 
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